Efficient algorithms for deciding the type of 

■^■. growth of products of integer matrices 

o 

i:^ I Raphael Jungers * Vladimir Protasovj Vincent D. Blondel 

Q_; February 1, 2008 

Abstract 

For a given finite set S of matrices with nonnegative integer entries 
v,^ I we study the growth of 



u 



X 



max(E) = max{\\A-i_ . . . At\\ : Ai e S}. 

We show how to determine in polynomial time whether the growth with t 
is bounded, polynomial, or exponential, and we characterize precisely all 
possible behaviors. 



> 

^ : 1 Introduction 

f^ ' In the last decade the joint spectral radius of sets of matrices has been the sub- 

V^ , ject of intense research due to its role for studying wavelets, switching systems, 

^D ' approximation algorithms, curve design, etc. [5,16,28]. The particular case of 

C/j , integer (rather than real) matrices is itself interesting due to the existence of 

O ' many applications where such matrices arise. For instance, the rate of growth 

of the binary partition function in combinatorial number theory is expressed in 

terms of the joint spectral radius of binary matrices, that is, matrices whose 

entries are zeros and ones [24,27]. Moision et al. [20-22] have shown how to 

C^ ' compute the capacity of a code under certain constraints (caused by the noise in 

a channel) with the joint spectral radius of binary matrices. Recently the joint 
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spectral radius of binary matrices has also been used to express trackability of 
mobiles in a sensor network [11]. 

For a given finite set S of matrices, the joint spectral radius of the set S, 
denoted p(S), is defined by the limit 

p(S) = lim max(S)i/* = lim max{|| Ai . . . ^t||i/* : A, e S}. 

t — *oo t t — >oo 

This limit exists for all finite sets of matrices and does not depend on the chosen 
norm. In the sequel we will mostly use the norm given by the sum of the absolute 
values of all matrix entries. Of course, for nonnegative matrices this norm is 
simply given by the sum of all entries. 

The problem of computing the joint spectral radius is known to be algo- 
rithmically undecidable in the case of arbitrary matrices. There are several 
known approximation algorithms [5,10,23,25], but all of them have exponential 
complexity either in the dimension of the matrices or in the accuracy of compu- 
tation. Even in the case of binary matrices, computing the joint spectral radius 
is not easy: that problem has been shown to be NP-hard [6]. 

In this paper, we focus on the case of nonnegative integer matrices and 
consider questions related to the growth with t of maxf (S). When the matrices 
are nonnegative all the following cases can possibly occur: 

1. /9(S) = 0. Then maxf (S) takes the value for all values of t larger than 
some to and so all products of length at least to are equal to zero. 

2. p(S) = 1 and the products of matrices in S arc bounded, that is, there is 
a constant K such that \\Ai . . . At\\ < K ior all Ai E S. 

3. p(S) ~ 1 and the products of matrices in S arc unbounded. We will show 
in this contribution that in this case the growth of maxt(I]) is polynomial. 

4. p(S) > 1. In this case the growth of maxt(S) is exponential. 

Note that the situation < /3(S) < 1 is not possible because the norm of a 
nonzero integer matrix is always larger than one. The cases (1) to (4) already 
occur when there is only one matrix in the set S. Particular examples for each 
of these four cases are given by the matrices: 

1\ (1 0\ (1 1\ (1 1 

The problem of distinguishing between the different cases has a long history. 
The polynomial-time decidability of the equality p{T,) = is shown in [15]. As 
mentioned by Blondel and Canterini [3], the decidability of the boundcdness 
of products of nonnegative integer matrices follows from results proved in the 
70s. Indeed, the finiteness of a semigroup generated by a finite set of matrices 
has been proved to be decidable independently by Jacob [17] and by Mandel 
and Simon [19]. It is clear that for integer matrices, finiteness of the semigroup 
is equivalent to its boundedness, and so boundcdness is decidable for integer 



matrices. The decision algorithms proposed in [17] and [19] are based on the 
fact that if the semigroup is finite, then every matrix in the semigroup can be 
expressed as a product of length at most B of the generators, and the bound 
B only depends on the dimension of the matrices n and on the number of 
generators. The proposed algorithms consist of generating all products of length 
less than B; and checking whether new products are obtained by considering 
products of length B + 1. The high value of the bound B does however lead 
to highly non polynomial algorithms and is therefore not practical. A sufficient 
condition for the unboundedness of maxt(S) was also derived recently for the 
case of binary matrices by Crespi et al. [11]. We show here that the condition 
given there is also necessary. Moreover, we provide a polynomial algorithm that 
checks this condition, and thus we prove that boundedness of semigroups of 
integer matrices is decidable in polynomial time. Crespi et al. [11] also provide 
a criterion to verify the inequality /^(E) > 1 for binary matrices and an algorithm 
based on that criterion. However, their algorithm is not polynomial^. In this 
paper, we present a polynomial algorithm for checking /9(E) > 1 for sets of 
nonnegative integer matrices. Let us note that the same problem for other 
joint spectral characteristics (such as the lower spectral radius or the Lyapunov 
exponent) is proved to be NP-hard even for binary matrices [30]. Therefore, the 
polynomial solvability of this question for the joint spectral radius is somewhat 
surprising. 

Our results have direct implications for all the problems that can be for- 
mulated in terms of a joint spectral radius of nonnegative integer matrices. In 
particular, it follows from our results that the trackability problem for sensor 
networks as formulated in [11] can be decided in polynomial time. The tracka- 
bility problem is as follows: we are given a directed graph with labelled nodes. 
Nodes may have identical labels and we consider successions of labels produced 
by directed paths in the graph. The function N{t) gives the largest number 
of paths that are compatible with some label sequence of length t. When the 
growth of N{t) is bounded or grows polynomially, the graph is said to be track- 
able. It has been shown in [11] that trackability can be decided by verifying 
that the joint spectral radius of two binary matrices constructed from the graph 
is less or equal to one. In this paper, this last property is shown to admit 
a polynomial time decision algorithm. Moreover, we provide an algorithm for 
computing the degree of the polynomial growth for trackable graphs. 

Our main results can be summarized as follows. For any finite set of non- 
negative integer n x n matrices E there is a polynomial algorithm that decides 
between the four cases p = 0, p = I and bounded growth, p — I and polynomial 
growth, p > 1 (see Theorem 1 and Theorem 2). Moreover, if p(E) = 1, then 
there exist constants Ci,C2, fc, such that Cit'' < maxt(E) < C2i'^ for alH; the 
rate of growth k is an integer such that < k < n -- 1, and there is a polyno- 

^The comments made here on the results presented in the Technical Report [11] refer to 
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some of their results and have incorporated some of the suggestions made by RJ and VB, as 
acknowledged in the updated version of the report dated December 19, 2005. 



mial time algorithm for computing k (see Theorem 3). This sharpens previously 
known results on the asymptotic of the value maxj (S) for nonnegative integer 
matrices. We discuss this aspect in Section 6. Thus, for nonnegative integer 
matrices, the only case for which we cannot decide the exact value of the joint 
spectral radius is p > 1. However, it is most likely that the joint spectral radius 
cannot be polynomially approximated in this case since it was proved that its 
computation is NP-hard, even for binary matrices [6,30]. 

The paper is organized as follows. Section |21 contains some notation and 
auxiliary facts from graph theory. In Section |31 we establish a criterion for 
separating the three main cases p(E) < l,p(S) = 1 and p(E) > 1. Applying 
this criterion we derive a polynomial algorithm that decides each of these cases. 
In Section0]we present a criterion for deciding product boundedness and provide 
a polynomial time implementation of this criterion. In Section |5l we find the 
asymptotic behavior of the value maxt(S) as t -^ cxd for the case p = 1. We 
prove that this value is asymptotically equivalent to t*^ for a certain integer k 
with < k < n — I and show how to find the rate of growth k in polynomial 
time. Finally, in Section we formulate several open problems on possible 
generalizations of those results to arbitrary matrices. 

2 Auxiliary facts and notation 

For a given finite set of matrices S we denote by S* the set of all products 
of length t of matrices from E. By E* we denote the union of all E* over all 
i > 0. For two nonnegative functions f{t),g{t) we use the standard notation 
f{t) = 0{g{t)), which means that there is a positive constant C such that 
/(i) < Cg{t) for all t. The functions / and g are said to be asymptotically 
equivalent, which we denote f{t) x g{t) if /(i) = 0{g{t)) and g{t) = 0{f{t)). 

We shall consider each nonnegative n x n matrix as the adjacency matrix 
of a directed weighted graph G. This graph has n nodes enumerated from 1 to 
n. There is an edge from node i to node j if the (i, j) entry of the matrix is 
positive and the weight of this edge is then equal to the corresponding entry. 
This graph may have loops, i.e., edges from a node to itself, which correspond 
to diagonal entries. If we are given a family E of nonnegative integer matrices, 
then we have several weighted graphs on the same set of nodes {1, . . . , n}. In 
addition we define the graph G'(E) associated to our family E as follows: There 
exists an edge in G(E) from node i to node j if and only if there is a matrix 
A G E such that Aij > 0. The weight of this edge is equal to max. Aij. We 

shall also use the graph G^ , whose n^ nodes represent the ordered pairs of our 
initial n nodes, and whose edges are defined as follows: there is an edge from a 
node (i, i') to {j,j') if and only if there is a matrix A G E such that both Aij 
and Aiiji are positive for the same matrix. The edges of G^ are not weighted. 
Products of matrices from E can be represented by cascade graphs. In a 
cascade graph, a matrix A G E is represented by a bipartite graph with a left 
and a right set of nodes. The sets have identical size and there is an edge 
between the ith left node and the jth right node if Ai,j > 0. The weight of this 
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Figure 1: A bipartite graph representing a binary matrix. 




Figure 2: A typical cascade graph. 

edge is equal to the entry Aij. For instance, the non-weighted bipartite graph 
on Figure n represents the matrix 




Now, for a given product of matrices Ad^ ■ ■ ■ Ad^ we construct a cascade graph 
as follows: we concatenate the corresponding bipartite graphs in the order in 
which they appear in the product, with the right side of each bipartite graph 
directly connected to the left side of the following graph. For example, Figurc[21 
shows a cascade graph representing the product ^o^i^o^i of length four, with 

^0 0\ /O 1 0^ 

Aq= \l 1 , Ai = 
^0 0/ lo 1 0; 



We say that the bipartite graph at the extreme left side begins at level t = 
and the one at the extreme right side ends at the last level. We note {i,t) to 
refer to the node i at level t. We say that there is a path from node i to node 
j if one is able to construct a cascade graph with a path from some node (i,t) 
to some node (j, t') for some t < t' . A path is to be understood as a succession 
of edges from a level to the next level, i.e. always from left to right. One can 
check that the (i,j) entry of a matrix product of length t is equal to the number 
of directed paths from the node («,0) to the node {j,t) in the corresponding 
cascade graph. We thus have a way of representing maxt(5]) as the maximal 
total number of paths from extreme left nodes to extreme right nodes in cascade 
graphs of length t. 

Two nodes of a graph are called connected if they arc connected by a path 
(not necessarily by an edge) . A directed graph is strongly connected if for any 
pair of nodes (i, j), i is connected to j. The following well known result states 
that we can partition the set of nodes of a directed graph in a unique way in 
strongly connected components, and that the links between those components 
form a tree [29] . 

Lemma 1. For any directed graph G there is a partition of its nodes in nonempty 
disjoint sets Vi, . . . ,Vj that are strongly connected and such that no two nodes 
belonging to different partitions are connected by directed paths in both direc- 
tions. Such a maximal decomposition is unique up to renumbering. Moreover 
there exists a (non necessarily unique) ordering of the subsets Vg such that any 
node i e Vfc cannot be connected to any node j G Vi, whenever k > I. There is 
an algorithm to obtain this partition in 0{n) operations (with n the number of 
nodes). 

In this lemma, wc suppose by convention that a node that is not strongly 
connected to any other node is itself a strongly connected subset, even if it does 
not have a self-loop. In such a case we will say that the corresponding set is 
a trivial strongly connected subset. Consider the graph G'(S) corresponding to 
a family of matrices S, as defined above. After possible renumbering, it can 
be assumed that the set of nodes is ordered, that is, for all nodes i ^ Vk and 
j <E Vi, ii k > I then i > j. In that case all the matrices of S have block 
upper-triangular form with / blocks corresponding to the sets Vi , . . . , V/ (/ can 
be equal to one). 

3 Deciding /? < 1 , p = I, and p > 1. 

Let E be a finite set of nonncgativc integer matrices and let p ~ /9(S) be their 
joint spectral radius. The goal of this section is to prove the following result. 



Theorem 1. For matrices with nonnegative integer entries there is a polynomial 
algorithm that decides the cases p < l,p = 1 and p > 1. 



Proof. The proof will be split into several lemmas. The inequality p < 1 means 
that the maximum number of paths in a cascade graph of length t tends to zero 
as i ^ oo. Hence for sufficiently large t there are no paths of this length in the 
graph G'(S) corresponding to the whole family S, since this graph represents 
the set of all possible edges. This means that G(S) has no cycles. So we get 
our first lemma : 

Lemma 2. For a finite set of nonnegative integer matrices S, we have p(S) > 
if and only if the graph G(S) has a cycle. In this case p > 1. 

This condition can be checked in 0{n) operations : one just has to find the 
strongly connected components of the graph GCS) (a task that can be performed 
in 0{n) operations [29]); a cycle will be possible iff one of the subsets is non 
trivial. The problem of deciding between p = I and p > 1 is more difficult. Let 
us start with the following lemma. 

Lemma 3. Let S be an arbitrary finite set of real matrices. If p(T.) > 1, then 
there is a product A Cz T.* , for which Ai^i > 1 for some i. If the matrices are 
nonnegative, then the converse is also true. 

Proof. SufHciency. Since A e S* has nonnegative elements, it follows that 
11^*^11 > A'y-, hence p{A) > A^^i > 1. It is well-known that for aU t, and for all 
A e S*, p(S) > p(A)i/*; therefore p(I]) > [p(A)]i/* > 1. 

Necessity. Since p(S) > 1 it follows that there is a product B G S* such that 
p{B) > 1 [2]. Let Ai be one eigenvalue of B of largest magnitude, so |Ai| = 
p{B) > 1 and let A2, . . . , A„ be the other eigenvalues. There exists a t sufficiently 
large such that |Ai|* > 2n and arg(A|) G (— f 1 f ) for all fc = 1, . . . , n, where 
arg(z) is the argument of the complex number z [31]. Therefore Re(A|,) > ^|A|| 

for aU fc. We have ^ {B*)k,k = trS* = E ^l = E R-cA*, > i|A*| > n. Since 

fe=i ' fe=i fc=i 

the sum of the n numbers {B*)k^k exceeds n, hence one of them must exceed 
1. ' D 

Corollary 1. For any finite set of nonnegative integer matrices E, we have 
p(S) > 1 if and only if there is a product A G S* such that Ai^i > 2 for some i. 

A different proof of this corollary can be found in Crespi et al. [11]. Thus, the 
problem is reduced to testing if there is a product A € T,* that has a diagonal 
element larger or equal to 2. This is equivalent to the requirement that at least 
one of the following conditions is satisfied: 

1. There is a cycle in the graph G(S) containing at least one edge of weight 
greater than 2. 

2. There is a cycle in the graph G^ containing at least one node (i,i) (with 
equal entries) and at least one node (p, q) with p ^ q. 



Indeed, if Ai,i > 2 for some A S S*, then either there is a path on the graph 
G(E) from i to i that goes through an edge of weight > 2 (first condition), or 
there are two different paths from i to i in the cascade graph corresponding 
to the product A, this is equivalent to the second condition. The converse is 
obvious. To verify Condition 1 one needs to look over all edges of G(I]) of 
weight > 2 and to check the existence of a cycle containing this edge. This 
requires at most n^ operations. To verify Condition 2 one needs to look over all 
^n^{n — 1) triples {i,p, q) with p > q and for each of them check the existence in 
the graph G^ of paths from (i, i) to {p, q) and from {p, q) to {i, i), which requires 
at most n? operations. Thus, to test Condition 2 one needs to perform at most 
n^ operations. This completes the proof of Theorem ^ D 

Figure 121 shows a cascade graph with the condition 2 of Corollary 1 satisfied: 
there are two paths from node 2 to node 2, and for every even t, the number of 
paths is multiplied by two. 

The shortest cycle in the graph G^ with the required properties has at most 
n^ edges. It therefore follows that whenever p(S) > 1, there is a product A 
of length less than n^ such that Ai^i > 2 for some i. From this we deduce the 
following corollary. 



Corollary 2. Let S be a finite set of nonnegative integer matrices of dimension 
n. If piY.) > 1, then p(E) > 2i/"'. 

4 Deciding product boundedness 

If p = 1, two different cases are possible: either the maximum norm of products 
of length t is bounded by a constant, or it grows with t. Deciding between these 
two cases is not trivial. In this section we present a simple criterion that allows 
us to decide whether the products are bounded. Our reasoning will be split into 
several lemmas. We begin with a simple but crucial observation. 

Lemma 4. Let T, be a finite set of nonnegative integer matrices with /o(S) = 1. 
// there is a product yl e S* that has an entry larger than 1, then the graph 
GCS) is not strongly connected. 

Proof. Let Ai^j > 2, that is, counting with weights, there are two paths from i to 
j in the same cascade graph. If there is another cascade graph with a path from 
j to ?, then, concatenating the two cascade graphs, we can find two different 
paths from i to itself, and by corollary ^^(I]) > 1, which is a contradiction. 
Hence G(S) is not strongly connected. D 

Consider the partition of the nodes of G(S) into strongly connected sets 
Vi, . . . ,Vi {cfr. Lemma ^. Applying Lemma 0] we get the following corollaries. 



Corollary 3. Let E be a finite set of nonnegative integer matrices. If p{Ti) — \, 
hut the products of these matrices are not uniformly hounded, then there exists 
a permutation matrix P such that for all matrix A in 'S, P^AP is block upper 
triangular with at least two blocks. 

Corollary 4. Let Y. be a finite set of nonnegative integer matrices with joint 
spectral radius one. Then all products of those matrices restricted to any strongly 
connected set Vk are binary matrices. 

We are now able to prove the main result of this section. We first provide 
a result for the case of one matrix and then consider the case of several matrices. 



Proposition 1. Let A be a nonnegative integer matrix with p{A) — 1. The set 
{II A* II : t > 1} is unbounded if and only if there exists some k > 1, and a pair 
of indices {i,j) such that 

4„4^,4^>i. (1) 

Proof. Sufficiency is easy: One can check that (yl'^*)^^ > t for any t, and hence 
maxt(S) is unbounded. Let us prove the necessity : Consider the partition in 
strongly connected subsets Vi, . . . , V/. By Corollary Owe have / > 2. 
We claim that there are two nontrivial sets Va and Vb, a <b that are connected 
by a path (there is a path from an element of Va to an element of Vb). Otherwise 
any path in 0(1]) intersects at most one nontrivial set, and we prove that their 
number must then be bounded : Let a path start from a set Va^ , then go to V^^ 
etc., until it terminates on Va, . We associate the sequence ai < • • • < a;, I < I 
to this path. As supposed, this sequence contains at most one nontrivial set, 
say Va^. There are at most K^ paths, counting with weights, corresponding to 
this sequence, where K is the largest number of edges between two given sets 
(still counting with weights). Indeed, each path of length t > I begins with the 
only edge connecting Va-^ to Va2 (since T4i is trivial), etc. until it arrives in Va^ 
after s — 1 steps (for each of the previous steps we had at most K variants), 
and the reasoning is the same if one begins by the end of the path, while, given 
a starting node in Va^, and a last node in the same set, there is at most one 
path between these two nodes, by corollary ^ Since there are finitely many 
sequences {oj}'^]^, I < I, we see that the total number of paths of length t is 
bounded by a constant independent of i, which contradicts the assumption. 
Hence there are two nontrivial sets Va and Vb, a < b connected by a path. 
Let this path go from a node ii & Va to ji ^ Vb and have length /. Since 
both graphs Va and VJ, are strongly connected, it follows that there is a cycle 
ii ^ ... ^> ip ^>- ii in Va and a path ji ^ . . . ^ ig — > ji in Vb, p,q > 1. Take 
now a number s G {1, . . . ,p} such that Z + s is divisible hy p : l + s — vp, u G N. 
Take a nonnegative integer x such that v+x is divisible by q : v+x = uq, it G N. 
Let us show that the matrix A^p'^ and the indices i = ip-s+i,j = ji possess 
property [3 Indeed, a path of length upq along the first cycle, beginning at 
node ip^s+i terminates to the same node, hence A^^^ ^ _ > 1. Similarly 



(^Mpg)^.^ ,^.^ > X On the other hand, the path going from «p_s+i -^ ■ ■ ■ ^ ii, 
then going x times around the first cycle from zi to itself, and then going from ii 
to ji, has a total length s + xp + l = vp + xp — upq, therefore A^^^^ ^ j^ > 1- □ 

The fact that there must be two nontrivial sets connected by a path had 
already been proved by Mandel and Simon [19, Lemma 2.6]. We now provide a 
generalization of this result to the case of several matrices. 



Proposition 2. Let Y, be a finite set of integer nonnegative matrices with 
p{Ti) = 1. The set of products norms {\\A\\ : A G S*} is unbounded if and 
only if there exists a product A ^ Y.* , and indices i and j (i ^ j ) such that 

Ai.i, Aij, Ajj > 1. (2) 

Proof. The sufficiency is obvious by the previous lemma. Let us prove the 
necessity. We have a set S of nonnegative integer matrices, and their products 
in Y* are unbounded. Consider again the partition of the nodes in strongly 
connected sets Vi, . . . ,Vi for S. Our proof proceeds by induction on /. For 
7 = 1 the products are bounded by corollary^ and there is nothing to prove. 
Let / > 2 and the theorem holds for any smaller number of sets in the partition. 
If on the set U = Lll^2^s the value maxt(I], U) is unbounded, then the theorem 
follows by induction. Suppose then that the products are bounded on this subset 
of nodes, by some constant M. Let us consider a product of t matrices, and 
count the paths from any leftmost node to any rightmost node. First, there are 
less than n^ paths beginning in Vi and ending in Vi, since the corresponding 
adjacency matrix must have {0, 1} entries (recall that n is the total number of 
nodes). Second, there are at most Mn^ paths beginning and ending in U, since 
each entry is bounded by M. Let us count the paths beginning in Vi and ending 
in U : Let zq ^ ■ • • ^ ?t be one of these paths. The nodes io, . . . V-i are in Vi, 
the nodes ir, . . . ,it are in U and ir-iir is an edge connecting Vi and U. The 
number r will be called a switching level. For any switching level there are at 
most KMn^ different paths connecting Vi with U, where K is the maximum 
number of edges jumping from Vi to U at the same level, counting with weights. 
Indeed for one switching edge v_i«r, the total number of paths from v to any 
node at the last level is bounded by M, and there are less than n nodes in U. 
By the same way of thinking, there is maximum one path from each node in Vi 
to ir-i, and there are less than n nodes in Vi. The number of switching levels 
is thus not bounded, because so would be the number of paths. To a given 
switching level r we associate a triple (A', A" , d), where A' = Ad, . . . Ad._,\ 

and A" — ^d^+i ■ • • Adt i are matrices and d — dr is the index of the rth matrix. 

The notation A\ means the square submatrix of A corresponding to the nodes 

I Vi 

in Vi. Since A' is a binary matrix (Corollary 0)) , A" is an integer matrix with 
entries less than M, and d can take finitely many values, it follows that there 
exist finitely many, say N, different triples {A',A",d). Taking t large enough, 
it can be assumed that the number of switching levels r G {2, . . . , t — 1} exceeds 
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A'', since for any switching level there are at most KMn? different paths. Thus, 
there are two switching levels r and r + s, s > 1 with the same triple. Define 
d = dr = dr+s and 

B = Ai... Ad^_, , D = Ad^^, . . . Ad,^^_, , E = A^^^^^, ...Aa, (3) 

(if s = 1, then D is the identity matrix). Thus, Ad^ ■ ■ ■ Ad^ ~ BAdDAdE. Since 
A' = B\ = BAdDt it follows that Bt = B{AdD)^ for any k. Similarly 

A" =Et= DAdE\ implies that E\ = {DAdfEi. Therefore for any k the 

cascade graph corresponding to the product B{AdD)^AdE has at least fc + 1 
paths of length t + (fc — l)s starting at io- Those paths have switching levels 
r,r + s, . . . ,r + {k — l)s respectively. Indeed, for any I G {0, . . . , A;} there is a 
path from iq to ir-i+is ~ V-i, because B{AdD)\ — B\ ; there is an edge 

Vi I ^'i 

from V-i+is to ir+is — in because ^d^+is ~ ^dr — ^d] finally there is a path 
from ir+is = *r to it+(j,„i)5 = it^ because {DAd)^^^E\ — E\ . Therefore, 

\\B{AdDYAdE\\ > fc + 1 for any fc, hence \\B{AdD)''AdE\\ ^ cx) as fc ^ oo, 
and so ||(yldl?)'^|| -^ oo. Now we apply the first part of the proof for the 
matrix AdD; since the powers of this matrix are unbounded it follows that 
some power A — {AdD)'', which is (A^^ . . . ^d^+^-i)'' possesses the property 
Ai^i, Ajj, Aij > 1 for suitable i and j. D 

There is also a different way to derive Proposition El Another proof can be 
based on the generic theorem of McNaughton and Zalestein, which states that 
every finite semigroup of matrices over a field is torsion [8] . We have given here 
a self contained proof for nonnegative integer matrices. 

The meaning of the condition ^ in terms of cascade graphs can be seen 
from the following simple example. If one matrix in S has those three entries 
(and no other) equal to one, then we have two infinite and separate paths: one 
is a circuit passing through the node i, the other is a circuit passing through 
the node j. Those cycles are linked in a unique direction, so that the first one 
is a source and the second one is a sink, that eventually collects all these paths, 
as shown on Figure 13 

We now prove that the criterion of Proposition [21 can be checked in polyno- 
mial time. 



Theorem 2. There is a polynomial time algorithm, for verifying product bound- 
edness of families of nonnegative integer matrices. 

Proof. Assume we are given a finite set of nonnegative integer matrices S. First, 
we decide between the cases p ~ Q,p = 1 and p > 1 with the algorithm provided 
in the previous section. In the first case maxt(I]) is bounded, in the latter it 
is not. The main problem is to check boundedness for the case p = 1. By 
PropositionElit suffices to check if there exists a product v4 e S* possessing the 
property of equation[21for some indices i, j. Consider the product graph G^ with 
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Figure 3: A cascade graph with hnear growth. 

n^ nodes defined as follows. The nodes of G^ are ordered triples {i,j, k), where 
z, J, k G {1, . . . , n}. There is an edge from a vertex {i, j, k) to a vertex {i' , j' , k') 
if and only if there is a matrix A G S, for which {A)i^i' , {A)j^ji , {A)k,k' > 1- (The 
adjacency matrix of G^ is obtained by taking the 3-th Kronecker power of each 
matrix in S, and by taking the maximum of these matrices componentwise.) 
The above condition means that there are indices i ^ j such that there is a 
path in G^ from the node {i,i,j) to the node {i,i,j). The algorithm involves 
checking n{n — 1) pairs, and for each pair at most n'^ operations to verify the 
existence of a path from {i,i,j) to {i,j,j). In total one needs to perform n^ 
operations to check boundedness. D 

5 The rate of polynomial growth 

We have provided in the previous section a polynomial time algorithm for check- 
ing product boundedness of sets of nonncgativc integer matrices. In this section 
we consider sets of matrices that are not product bounded and we analyze the 
rate of growth of the value maxt(S) when t grows. When the set S consists of 
only one matrix A with spectral radius equal to one, the norm of A'^ increases 
polynomially with k and the degree of the polynomial is given by the size of 
the largest Jordan block of eigenvalue one. A generalization of this for several 
matrices is given in the following theorem. 

Theorem 3. For any finite set S of integer nonnegative matrices with /9(S) = 1 
there are positive constants Ci and C2 and an integer k > (the rate of growth) 
such that 

Cit'' < max(S) < C2t'' (4) 

for all t. The rate of growth k is the largest integer possessing the following 
property: there exist k different ordered pairs of indices (ii, ji), . . . , {ik, jk) such 
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Figure 4: A cascade graph with polynomial growth. 
that for every pair {is,js) there is a product yl G E*, for which 

^is,isi ^isJsJ ^jsjs — 1; \") 

and for each 1 < s < fc — 1, there exists B ^ Y.* such that Bj^,i^^-^ > 1. 

The idea behind this theorem is the following: if we have a polynomial 
growth of degree k, we must have a combination of k linear grows that combine 
themselves successively to create a growth of degree k. This can be illustrated 
by the cascade graph in Figure^ 

Before we give a proof of TheoremOllet us observe one of its corollary. Con- 
sider the ordered chain of maximal strongly connected subsets Vi, . . . ,Vi for our 
set S. By Corollary 01 the elements is,js of each pair {is,js) belong to different 
sets, with, if is G Vi^,js G Vj^, js > is- This impHes that there are less such 
couples than strongly connected subsets, and then: 



Corollary 5. The rate of growth k does not exceed I ~1, where I is the number 
of strongly connected sets of the family E. In particular, fc < 7i — 1. 

We may now provide the proof of Theorem 13 

Proof. We shall say that a node i is 0{t^) if there is a constant C > such 
that max Ai , < Ct^ for all t. Suppose that for some k we have k pairs 

(ii, ji), . . . , (ikijk) satisfying the assumption of the theorem. We construct a 
cascade graph similar to the one represented in Figure^ Let As, s — 1, . . . ,k 
and Bg, s = 1, . . . , fc — 1 be the corresponding products and m be their maxi- 
mal length. Then for any s and any p £ N one has {AP)ij^ > p, and therefore 
(^A^BiA2B2 ■ ■ ■ A^) . . > p'' for any p. Denote this product by Dp and its 
length by Ip. Obviously Ip < [pk + fc — l)m. For an arbitrary t > (2fc — l)m, 
take the largest p such that Ip < t. It follows that Ip > t ~ km, and therefore 
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P > -^ — 1 + -^ > T^ ~ 2 + i- ^^ order to complete the product, take for 
instance A^, '' . Then the product DpA^^ ^ has length t and its (iij/c)-entry is 

bigger than p^ > (-^ — 2 + -1) , which is bigger than Ct'^ for some positive 
constant C. This proves sufficiency. 

It remains to establish the converse: if for some k there is a node that is not 
0{t^~^), then there exist k required pairs of indices. We prove this by induction 
in the dimension n (number of nodes). For n = 2 and fc = 1 it follows from 
Proposition|21 For n = 2 and fc > 2 this is impossible, since one node (say, node 
1) is an invariant by CoroUaryO then the edge (1, 2) is forbidden, and there is 
at most t + 2 paths of length t (if all other edges occur at each level) . 
Suppose the theorem holds for all n' < n — 1. Let a node iq be not 0{t^''^). As- 
sume first that there are two nodes i, j of the graph G'(S) that are not connected 
by any path. Therefore there are no paths containing both these nodes. Hence 
one can remove one of these nodes (with all corresponding edges) so that ig is 
still not 0(t'^~^). Now by induction the theorem follows. It remains to consider 
the case when any pair of nodes is (weakly) connected. Take the decomposition 
in strongly connected subsets Vi, . . . ,Vi for E. The nodes are ordered so that 
all the matrices in E are in block upper triangular form. Let p be the smallest 
integer such that all nodes in Gp — uf^pK, are 0(1), i.e., Gp is the biggest 
invariant on which the number of paths is bounded. By Corollary ^ such p does 
exist. On the other hand, by the assumption we have p > 2. Since the prod- 
ucts in E* restricted to the subspace corresponding to Gp_i — GpLi Vp-i are 
unbounded, it follows from Proposition|21that there is a pair {ik,jk) G Gp_i re- 
alizing equation 121 Observe that ik G Vp-i and jk G Gp. Otherwise both these 
nodes are either in Vp^i (hence the restriction of E* to Ip-i i^ unbounded, 
which violates Corollary Q or in Gp (contradicts the boundedness of E* on Gp). 
Now consider the products restricted on the set U^Z^ Vs . We claim that at least 
one node is not 0{t^~^) in this restriction: For any product in E* of length 
t consider the corresponding cascade graph. Any path of length t starting at 
a node i G U^Zj^ Vs consists of 3 parts (some of them may be empty) : a path 
i ^ V E Uj~]^Kj of some length Z, an edge v ^ u G Gp, and a path from u inside 
Gp of length t — l — 1. Suppose that each entry in the restriction of the products 
to U^ZjT4 is 0{t'^^^), then for a given I there are at most Cl''~^ paths for the 
first part (C > is a constant), for each of them the number of different edges 
V ^ u (counting with edges) is bounded by a constant K, and the number of 
paths from u to the end is bounded by Co by the assumption. Taking the sum 
over all I we obtain at most J2i=o^-^^ol''~^ = 0{t''~^) paths, which contra- 
dicts our assumption. 

Hence there is a node in U^Zj^ Vs that is not 0{t''^^). Applying now the inductive 
assumption to this set of nodes we obtain fc — 1 pairs (is,js), s = 1, . . . , fc — 1 
with the required properties. Note that they are different from {ik,jk), because 
jk G Gp. It remains to show that there is a path in G(E) from jk-i to ik- Let 
us remember that ik £ Vp-i. li jk-i £ V^-i as well, then such a path exists, 
because Vp-i is strongly connected. Otherwise, if jk-i & Vj for some j < p — 1, 
then there is no path from ik to jk-i, which yields that there is a path from 
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jk-1 to ik, since each pair of nodes is weakly connected. D 

Let us note that the products of maximal growth constructed in the proof 
of Theorem O are not periodic, that is, the optimal asymptotic product is not 
the power of one product. Indeed, we multiply the first matrix Ai p times, and 
then the second one p times, etc. This leads to a family of products of length 
t that are not the repetition of a period. In general, those aperiodic products 
can be the optimal ones, as illustrated by the following simple example. 
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Any finite product of these matrices has spectral radius equal to one and has 
at most linear growth. Indeed, every A G S has rank at most two, therefore 
the condition of Theorem 13 for any fc = 2 is not satisfied for the product A. 
Nevertheless, the aperiodic sequence of products of the type A/ A2 gives a 
quadratic growth in t. It is interesting to compare this phenomenon with the 
well-known finiteness property of linear operators [7,9, 18]: for this set of ma- 
trices, the maximal behavior is a quadratic growth, which is possible only for 
aperiodic products. On the other hand, considering the boundedness of the 
products such phenomenon is impossible: by Proposition [3 if niaxt(E) is un- 
bounded, this unbounded growth can always be obtained by a periodic sequence. 
This fact is true only for nonnegative integer matrices, since the following ex- 
ample gives a set of complex matrices for which the products are unbounded 
while all periodic products are bounded: 

e*»2. 1\ /e^«2. 
ij'l, 1 

If < < 1 is irrational, then the powers of any A G E* are bounded, while 
maxt(E) grows linearly in t. 



Proposition 3. The rate of growth of a set of nonnegative integer matrices can 
be found in polynomial time. 

Proof. For each pair {i, j) of vertices one can check in polynomial time whether 
there is a product A such that Aij > 1, Ai,i = Ajj = 1. For each couple 
of those pairs (ii, j'l), (12, ^2), we can check in polynomial time whether there 
is a path from j'l to 12, or from J2 to ii. Finally we are left with a directed 
graph whose nodes are the couples {i,j) satisfying equation 13 and with an edge 
between the nodes (ii, ji), (i2, J2) if there is a path from ji to 12. This graph is 
acyclic (because if there is also a path from J2 to «i then there are two paths 
from ii to itself, and p > 1 by Lemma OJ, and it is known that the problem 
of finding a longest path in a directed acyclic graph can be solved in linear 
time. n 
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6 Polynomial growth for arbitrary matrices 

Theorem 13 shows that for a finite family E of nonnegative integer matrices with 
joint spectral radius equal to one the value maxt(E) is asymptotically equivalent 
to t^, where k is an integer. Moreover, we have shown that the exponent k can 
be computed in polynomial time. A natural question arises: do these properties 
hold for all sets matrices (without the constraint of nonnegative integer entries)? 



Problem 1. Is this true that for any family of matrices S (real or complex) 
with p(S) = 1 one has max((S) x t'^ for some integer k ? 

In other words, is the asymptotic behavior of the value maxt(I]) really poly- 
nomial with an integer rate of growth? This property can obviously be reformu- 
lated without the restriction p(S) = 1 as follows: is it true that for any family 
of matrices S we have 

max(S) X pH'', (6) 

where p = p(S) and k is an integer ? A more general problem arises if we re- 
move the strict requirements of asymptotic equivalence up to a positive constant: 



Problem 2. Is this true that for any family of matrices E the following limit 

lim ^^P-'^^M^)^ (7) 

t^oo Int ^ ^ 

exists and is always an integer? 

In particular, does property © or, more generally, property Q hold for 
nonnegative integer matrices ? If the answer is positive, can the rate of growth 
be computed? We have solved these problems only for the case p = 1. Thus, is it 
possible to obtain a sharper information on the asymptotic behavior of the value 
maxt(S) as i ^ oo than the well-known relation lim lnmax4(I])/t — In /9(E)? 

t — ^CXD 

The question is reduced to the study of the value r{t) = /3^*max((E). For 
some special families of matrices this question has appeared in the literature 
many times. S. Dubuc in 1986 studied it for a special pair of 2 x 2 matrices 
in connection with the rate of convergence of some approximation algorithm 
[14]. In 1991 I. Daubechies and J. Lagarias [12] estimated the value r{t) for 
special pairs of n x n matrices to get a sharp information on the continuity of 
wavelets and reflnable functions, and their technique was developed in many 
later works (see [16] for references). In 1990 B. Reznik [27] formulated several 
open problems on the asymptotic of binary partition functions (combinatorial 
number theory) that were actually reduced to computing the value r{t) for 
special binary matrices [24]. This value also appeared in other works, in the 
study of various problems [10,13,28]. For general families of matrices very little 
is known about the asymptotic behavior of r{t), although some estimations 
are available. First, if the matrices from E do not have a nontrivial common 
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invariant subspace, then r(t) x 1, i.e., Ci < p~* maxt(E) < C2 for some positive 
constants Ci,C2 [2,23,32]. So, in this case the answer to problem ^ is positive 
with fc = 0. This assumption was relaxed for nonnegative matrices in [24]. 
It was shown that if a family of nonnegative matrices is irreducible (has no 
common invariant subspaces among the coordinate planes), then we still have 
r{t) X 1. For all other cases, if the matrices are arbitrary and may have common 
invariant subspaces, we have only rough estimations. For the lower bound we 
always have r(t) > C [23]. For the upper bound, as it was independently shown 
in [12] and [1], we have r{t) < Cf^^^ . This upper bound was sharpened in the 
following way [10]. Let I be the maximal integer such that there is a basis in 
R", in which all the matrices from E get a block upper-triangular form with I 
blocks. Then r{t) < Ct^^^ . The next improvement was obtained in [26]. Let 
E = {Ai, . . . , A^v} and each matrix A^ G E are in upper triangular form, with 
diagonal blocks B\, . . . ,B\. Let s be the total number of indices j £ {1, . . . , ^} 
such that p{B{, . . . , Bj^) = p(E). Then r{t) < Ct"-^. Thus, for an arbitrary 
family of matrices we have Ci < p~*maxt(E) < C2t^^^ ■ To the best of our 
knowledge this is the sharpest information about the asymptotic behavior of 
r{t) available thus far. 

7 Conclusion and remarks 

The results of this paper completely characterize finite sets of nonnegative inte- 
ger matrices with bounded products and with polynomially growing products. 
Without any changes the results can be applied to general sets of nonnegative 
matrices, if the values of the entries between zero and one are forbidden. Unlike 
the proofs, which are quite technical, the results are easily implementable in 
algorithms. One question we are not addressing in this paper is that of the 
exact computation of the joint spectral radius when p > 1; but this problem is 
known to be NP-hard even for binary matrices. We also provide an example 
of two matrices whose joint spectral radius is one but for which the optimal 
asymptotic behavior is not periodic. This example may possibly help for the 
analysis of the finiteness property that was conjectured in [4] to hold for binary 
matrices. Finally, in the last section we leave several open problems on possible 
generalizations of these results for more general sets of matrices. 
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